Introduce a new extension for generating Dockerfiles #42316

iocanel · 2024-08-05T12:54:08Z

Updates:

Applied feedback from gsmet
Replaced String.format with Qute.fmt
dockerfiles command now forces quarkus-dockerfiles as dependency

gsmet

This looks good over all, I spotted only micro issues.

Not sure who would have the time to test this one. @maxandersen do you have somebody in mind?

extensions/dockerfiles/picocli/pom.xml

...les/deployment/src/main/java/io/quarkus/dockerfiles/deployment/DockerfilesConfiguration.java

extensions/dockerfiles/runtime/src/main/resources/META-INF/quarkus-extension.yaml

extensions/dockerfiles/cli/pom.xml

gsmet · 2024-08-09T08:15:53Z

Hey @iocanel . The feature freeze for 3.14 and 3.15 LTS is next Tuesday so we should really try to finalize this as it's an awesome feature.

Someone asked about it here #42441 and I was thinking of asking them to test but... we need instructions on how to install it as I don't think it comes by default?

gsmet

I added some additional comments that need fixing.

I saw you asked for a review by @maxandersen and @cescoffier anyway so I will let it there until they have time to review it.

...les/deployment/src/main/java/io/quarkus/dockerfiles/deployment/DockerfilesConfiguration.java

gsmet · 2024-08-12T09:37:43Z

I'm also wondering if in the future we should generate the default Dockerfiles from there to be consistent.

ia3andy · 2024-08-20T07:11:58Z

@iocanel any reason not to continue on what you started with codestarts?

ia3andy · 2024-08-20T07:17:53Z

It should be possible to share the same templates as the existing codestarts and use a subset part of the codestart generator for generation.

cescoffier

I may have missed something but where extensions can add packages and files to the generated docker files?

So far I only see the "from" customization.

iocanel · 2024-09-03T13:26:41Z

I may have missed something but where extensions can add packages and files to the generated docker files?

So far I only see the "from" customization.

What I had in my mind is to deal with just #41772 and leave the rest for future prs. If you feel that this needs to be done in one go, please let me know.

github-actions · 2024-10-01T05:57:21Z

🎊 PR Preview a98fb44 has been successfully built and deployed to https://quarkus-pr-main-42316-preview.surge.sh/version/main/guides/

Images of blog posts older than 3 months are not available.
Newsletters older than 3 months are not available.

cescoffier · 2024-11-10T16:59:50Z

@iocanel Where are we on this?

iocanel · 2024-11-11T06:16:04Z

@iocanel Where are we on this?
AFAIR, @gsmet and @ia3andy concerns have been addressed. So, we could possible or merge.

...eployment/src/main/java/io/quarkus/deployment/builditem/SetClassPathSystemPropBuildItem.java

cescoffier · 2024-11-17T15:08:22Z

extensions/dockerfiles/cli/pom.xml

+        <plugins>
+            <plugin>
+                <groupId>io.quarkus</groupId>
+                <artifactId>quarkus-maven-plugin</artifactId>


In my case it was a problem to have CLI be a quarkus app. Check you can build from scratch.

cescoffier · 2024-11-17T15:08:41Z

extensions/dockerfiles/cli/src/main/java/io/quarkus/dockerfiles/cli/Dockerfiles.java

+import picocli.CommandLine.Parameters;
+
+@TopCommand
+@Command(name = "dockerfiles", sortOptions = false, mixinStandardHelpOptions = false, header = "Generate Dockerfiles.", headerHeading = "%n", commandListHeading = "%nCommands:%n", synopsisHeading = "%nUsage: ", optionListHeading = "%nOptions:%n")


Suggested change

@Command(name = "dockerfiles", sortOptions = false, mixinStandardHelpOptions = false, header = "Generate Dockerfiles.", headerHeading = "%n", commandListHeading = "%nCommands:%n", synopsisHeading = "%nUsage: ", optionListHeading = "%nOptions:%n")

@Command(name = "dockerfiles", sortOptions = false, mixinStandardHelpOptions = false, header = "Generate Dockerfiles/Containerfiles.", headerHeading = "%n", commandListHeading = "%nCommands:%n", synopsisHeading = "%nUsage: ", optionListHeading = "%nOptions:%n")

cescoffier · 2024-11-17T15:09:02Z

extensions/dockerfiles/cli/src/main/java/io/quarkus/dockerfiles/cli/Dockerfiles.java

+    @Option(names = { "--native" }, paramLabel = "", order = 5, description = "Flag to enable Native Dockerfile generation")
+    boolean generateNativeDockerfile;
+
+    @Parameters(arity = "0..1", paramLabel = "GENERATION_PATH", description = " The path to generate Dockerfiles")


Suggested change

@Parameters(arity = "0..1", paramLabel = "GENERATION_PATH", description = " The path to generate Dockerfiles")

@Parameters(arity = "0..1", paramLabel = "GENERATION_PATH", description = "The path to generate Dockerfiles")

cescoffier · 2024-11-17T15:10:05Z

extensions/dockerfiles/cli/src/main/java/io/quarkus/dockerfiles/cli/Dockerfiles.java

+    private static final ArtifactDependency QUARKUS_DOCKERFILES_SPI = new ArtifactDependency("io.quarkus",
+            "quarkus-dockerfiles-spi", null, "jar", Dockerfiles.getVersion());
+
+    @Option(names = { "--jvm" }, paramLabel = "", order = 5, description = "Flag to enable JVM Dockerfile generation")


Does it generate all the variants or a single one (in this case, which one?)

No it doesn't. By default a jvm Dockerfile will be generated, unless the user implies native by option or Dockerfile suffix.
In such cases this option is available to also generate a jvm file:

No options -> Jvm

Native options -> Native

Native options + Jvm Options -> Native + Jvm

cescoffier · 2024-12-02T07:55:11Z

@iocanel ping.

iocanel · 2024-12-02T08:44:43Z

I'll get back to it this week

cescoffier · 2025-01-06T08:50:06Z

@iocanel Hey! Gently "happy new year" reminder :-)

iocanel · 2025-01-17T11:35:56Z

I am now back at it.

quarkus-bot · 2025-01-17T14:16:45Z

Status for workflow `Quarkus Documentation CI`

This is the status report for running Quarkus Documentation CI on commit fb049e5.

✅ The latest workflow run for the pull request has completed successfully.

It should be safe to merge provided you have a look at the other checks in the summary.

Warning

There are other workflow runs running, you probably need to wait for their status before merging.

quarkus-bot · 2025-01-17T18:55:29Z

Status for workflow `Quarkus CI`

This is the status report for running Quarkus CI on commit fb049e5.

Failing Jobs

Status	Name	Step	Failures	Logs	Raw logs	Build scan
✖	Native Tests - Misc4	`Build`	Failures	Logs	Raw logs	🔍

Full information is available in the Build summary check run.
You can consult the Develocity build scans.

Failures

⚙️ Native Tests - Misc4 #

- Failing: integration-tests/gradle

📦 integration-tests/gradle

✖ io.quarkus.gradle.nativeimage.BasicJavaNativeBuildIT.shouldBuildNativeImage - History - More details - Source on GitHub

java.lang.AssertionError: Gradle build failed with exit code 137
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:140)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:57)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:52)
	at app//io.quarkus.gradle.nativeimage.QuarkusNativeGradleITBase.runGradleWrapper(QuarkusNativeGradleITBase.java:36)
	at app//io.quarkus.gradle.nativeimage.BasicJavaNativeBuildIT.shouldBuildNativeImage(BasicJavaNativeBuildIT.java:24)
	at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
	at [email protected]/java.util.ArrayList.forEach(ArrayList.java:1511)

✖ io.quarkus.gradle.nativeimage.BasicJavaNativeBuildIT.shouldBuildNativeImageWithCustomName - History - More details - Source on GitHub

java.lang.AssertionError: Gradle build failed with exit code 137
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:140)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:57)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:52)
	at app//io.quarkus.gradle.nativeimage.QuarkusNativeGradleITBase.runGradleWrapper(QuarkusNativeGradleITBase.java:36)
	at app//io.quarkus.gradle.nativeimage.BasicJavaNativeBuildIT.shouldBuildNativeImageWithCustomName(BasicJavaNativeBuildIT.java:53)
	at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
	at [email protected]/java.util.ArrayList.forEach(ArrayList.java:1511)

✖ io.quarkus.gradle.nativeimage.BasicJavaNativeBuildIT.shouldBuildNativeImageWithCustomNameWithoutSuffix - History - More details - Source on GitHub

java.lang.AssertionError: Gradle build failed with exit code 137
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:140)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:57)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:52)
	at app//io.quarkus.gradle.nativeimage.QuarkusNativeGradleITBase.runGradleWrapper(QuarkusNativeGradleITBase.java:36)
	at app//io.quarkus.gradle.nativeimage.BasicJavaNativeBuildIT.shouldBuildNativeImageWithCustomNameWithoutSuffix(BasicJavaNativeBuildIT.java:84)
	at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
	at [email protected]/java.util.ArrayList.forEach(ArrayList.java:1511)

✖ io.quarkus.gradle.nativeimage.CustomNativeTestSourceSetIT.runNativeTests - History - More details - Source on GitHub

java.lang.AssertionError: Gradle build failed with exit code 137
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:140)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:57)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:52)
	at app//io.quarkus.gradle.nativeimage.QuarkusNativeGradleITBase.runGradleWrapper(QuarkusNativeGradleITBase.java:36)
	at app//io.quarkus.gradle.nativeimage.CustomNativeTestSourceSetIT.runNativeTests(CustomNativeTestSourceSetIT.java:17)
	at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
	at [email protected]/java.util.ArrayList.forEach(ArrayList.java:1511)

✖ io.quarkus.gradle.nativeimage.NativeIntegrationTestIT.nativeTestShouldRunIntegrationTest - History - More details - Source on GitHub

java.lang.AssertionError: Gradle build failed with exit code 137
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:140)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:57)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:52)
	at app//io.quarkus.gradle.nativeimage.QuarkusNativeGradleITBase.runGradleWrapper(QuarkusNativeGradleITBase.java:36)
	at app//io.quarkus.gradle.nativeimage.NativeIntegrationTestIT.nativeTestShouldRunIntegrationTest(NativeIntegrationTestIT.java:24)
	at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
	at [email protected]/java.util.ArrayList.forEach(ArrayList.java:1511)

✖ io.quarkus.gradle.nativeimage.NativeIntegrationTestIT.runNativeTestsWithOutputName - History - More details - Source on GitHub

java.lang.AssertionError: Gradle build failed with exit code 137
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:140)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:57)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:52)
	at app//io.quarkus.gradle.nativeimage.QuarkusNativeGradleITBase.runGradleWrapper(QuarkusNativeGradleITBase.java:36)
	at app//io.quarkus.gradle.nativeimage.NativeIntegrationTestIT.runNativeTestsWithOutputName(NativeIntegrationTestIT.java:35)
	at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
	at [email protected]/java.util.ArrayList.forEach(ArrayList.java:1511)

✖ io.quarkus.gradle.nativeimage.NativeIntegrationTestIT.runNativeTestsWithoutRunnerSuffix - History - More details - Source on GitHub

java.lang.AssertionError: Gradle build failed with exit code 137
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:140)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:57)
	at app//io.quarkus.gradle.QuarkusGradleWrapperTestBase.runGradleWrapper(QuarkusGradleWrapperTestBase.java:52)
	at app//io.quarkus.gradle.nativeimage.QuarkusNativeGradleITBase.runGradleWrapper(QuarkusNativeGradleITBase.java:36)
	at app//io.quarkus.gradle.nativeimage.NativeIntegrationTestIT.runNativeTestsWithoutRunnerSuffix(NativeIntegrationTestIT.java:45)
	at [email protected]/java.lang.reflect.Method.invoke(Method.java:569)
	at [email protected]/java.util.ArrayList.forEach(ArrayList.java:1511)

Flaky tests - Develocity

⚙️ JVM Tests - JDK 21

📦 extensions/smallrye-reactive-messaging/deployment

✖ io.quarkus.smallrye.reactivemessaging.hotreload.ConnectorChangeTest.testUpdatingConnector - History

Expecting actual: ["-4","-5","-6","-7","-8","-9","-10","-11"] to start with: ["-3", "-4", "-5", "-6"] - java.lang.AssertionError

java.lang.AssertionError: 

Expecting actual:
  ["-4","-5","-6","-7","-8","-9","-10","-11"]
to start with:
  ["-3", "-4", "-5", "-6"]

	at io.quarkus.smallrye.reactivemessaging.hotreload.ConnectorChangeTest.testUpdatingConnector(ConnectorChangeTest.java:36)

quarkus-bot bot added the area/dependencies Pull requests that update a dependency file label Aug 5, 2024

This comment has been minimized.

Sign in to view

iocanel force-pushed the gen-dockerfiles-from branch from ad21261 to 1866652 Compare August 6, 2024 06:07

This comment has been minimized.

Sign in to view

iocanel force-pushed the gen-dockerfiles-from branch from 1866652 to 4092aca Compare August 6, 2024 08:17

This comment has been minimized.

Sign in to view

iocanel force-pushed the gen-dockerfiles-from branch from 4092aca to afcb767 Compare August 6, 2024 08:47

This comment has been minimized.

Sign in to view

iocanel force-pushed the gen-dockerfiles-from branch from afcb767 to 8b617f8 Compare August 6, 2024 10:01

quarkus-bot bot added area/devtools Issues/PR related to maven, gradle, platform and cli tooling/plugins area/documentation labels Aug 6, 2024

This comment has been minimized.

Sign in to view

iocanel force-pushed the gen-dockerfiles-from branch from 8b617f8 to 7ffcce4 Compare August 6, 2024 10:35

geoand requested review from cescoffier and maxandersen August 6, 2024 13:53

This comment has been minimized.

Sign in to view

quarkus-bot bot added the triage/flaky-test label Aug 6, 2024

gsmet reviewed Aug 8, 2024

View reviewed changes

gsmet mentioned this pull request Aug 8, 2024

Centralize reference to UBI images (and maybe others) #42389

Closed

gsmet requested changes Aug 12, 2024

View reviewed changes

maxandersen mentioned this pull request Aug 19, 2024

Codestart modularize Dockerfiles #42601

Closed

cescoffier requested changes Aug 20, 2024

View reviewed changes

iocanel force-pushed the gen-dockerfiles-from branch from 7ffcce4 to ab5590e Compare September 30, 2024 08:23

quarkus-bot bot added area/cli Related to quarkus cli (not maven/gradle/etc.) area/core labels Sep 30, 2024

This comment has been minimized.

Sign in to view

iocanel force-pushed the gen-dockerfiles-from branch from ab5590e to 95984d7 Compare October 1, 2024 05:21

This comment has been minimized.

Sign in to view

iocanel requested review from gsmet and cescoffier November 11, 2024 06:16

cescoffier requested changes Nov 17, 2024

View reviewed changes

iocanel force-pushed the gen-dockerfiles-from branch 2 times, most recently from 59ded5f to 13b326a Compare January 17, 2025 11:55

This comment has been minimized.

Sign in to view

feat: Introduce a new extension for generating Dockerfiles

fb049e5

iocanel force-pushed the gen-dockerfiles-from branch from 13b326a to fb049e5 Compare January 17, 2025 13:48

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Introduce a new extension for generating Dockerfiles #42316

Introduce a new extension for generating Dockerfiles #42316

iocanel commented Aug 5, 2024 •

edited

Loading

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

gsmet left a comment

gsmet commented Aug 9, 2024

gsmet left a comment

gsmet commented Aug 12, 2024

ia3andy commented Aug 20, 2024 •

edited

Loading

ia3andy commented Aug 20, 2024

cescoffier left a comment

iocanel commented Sep 3, 2024

This comment has been minimized.

github-actions bot commented Oct 1, 2024 •

edited

Loading

This comment has been minimized.

This comment has been minimized.

cescoffier commented Nov 10, 2024

iocanel commented Nov 11, 2024

cescoffier Nov 17, 2024

cescoffier Nov 17, 2024

cescoffier Nov 17, 2024

cescoffier Nov 17, 2024

iocanel Jan 17, 2025

cescoffier commented Dec 2, 2024

iocanel commented Dec 2, 2024

cescoffier commented Jan 6, 2025

iocanel commented Jan 17, 2025

This comment has been minimized.

This comment has been minimized.

quarkus-bot bot commented Jan 17, 2025

quarkus-bot bot commented Jan 17, 2025 •

edited by github-actions bot

Loading

	@Command(name = "dockerfiles", sortOptions = false, mixinStandardHelpOptions = false, header = "Generate Dockerfiles.", headerHeading = "%n", commandListHeading = "%nCommands:%n", synopsisHeading = "%nUsage: ", optionListHeading = "%nOptions:%n")
	@Command(name = "dockerfiles", sortOptions = false, mixinStandardHelpOptions = false, header = "Generate Dockerfiles/Containerfiles.", headerHeading = "%n", commandListHeading = "%nCommands:%n", synopsisHeading = "%nUsage: ", optionListHeading = "%nOptions:%n")

	@Parameters(arity = "0..1", paramLabel = "GENERATION_PATH", description = " The path to generate Dockerfiles")
	@Parameters(arity = "0..1", paramLabel = "GENERATION_PATH", description = "The path to generate Dockerfiles")

Introduce a new extension for generating Dockerfiles #42316

Are you sure you want to change the base?

Introduce a new extension for generating Dockerfiles #42316

Conversation

iocanel commented Aug 5, 2024 • edited Loading

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

This comment has been minimized.

gsmet left a comment

Choose a reason for hiding this comment

gsmet commented Aug 9, 2024

gsmet left a comment

Choose a reason for hiding this comment

gsmet commented Aug 12, 2024

ia3andy commented Aug 20, 2024 • edited Loading

ia3andy commented Aug 20, 2024

cescoffier left a comment

Choose a reason for hiding this comment

iocanel commented Sep 3, 2024

This comment has been minimized.

github-actions bot commented Oct 1, 2024 • edited Loading

This comment has been minimized.

This comment has been minimized.

cescoffier commented Nov 10, 2024

iocanel commented Nov 11, 2024

cescoffier Nov 17, 2024

Choose a reason for hiding this comment

cescoffier Nov 17, 2024

Choose a reason for hiding this comment

cescoffier Nov 17, 2024

Choose a reason for hiding this comment

cescoffier Nov 17, 2024

Choose a reason for hiding this comment

iocanel Jan 17, 2025

Choose a reason for hiding this comment

cescoffier commented Dec 2, 2024

iocanel commented Dec 2, 2024

cescoffier commented Jan 6, 2025

iocanel commented Jan 17, 2025

This comment has been minimized.

This comment has been minimized.

quarkus-bot bot commented Jan 17, 2025

Status for workflow Quarkus Documentation CI

quarkus-bot bot commented Jan 17, 2025 • edited by github-actions bot Loading

Status for workflow Quarkus CI

Failing Jobs

Failures

⚙️ Native Tests - Misc4 #

📦 integration-tests/gradle

Flaky tests - Develocity

⚙️ JVM Tests - JDK 21

📦 extensions/smallrye-reactive-messaging/deployment

iocanel commented Aug 5, 2024 •

edited

Loading

ia3andy commented Aug 20, 2024 •

edited

Loading

github-actions bot commented Oct 1, 2024 •

edited

Loading

Status for workflow `Quarkus Documentation CI`

quarkus-bot bot commented Jan 17, 2025 •

edited by github-actions bot

Loading

Status for workflow `Quarkus CI`